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ABSTRACT 


A model developed recently uses regression and analytic techniques 
to estimate the length of service (LOS) distribution of advancements in 
the Navy Enlisted Force by pay grade and rating. The distribution is a 
function of the total volume of advancees to a pay grade of the rating 
as well as the LOS distribution of the net inventory of the next lower 
pay grade of the same rating. The model previously tested for three 
ratings only is now extended to all ratings of the Navy Enlisted Force. 
The new procedure is then compared and found to be superior to the cur- 
rently used method of distributing advancees among LOS cells. This con- 


clusion is based on the accuracy of the FY 1976 estimates. 
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FOREWORD 


This research effort was initiated by the Naval Personnel Research 
and Development Center (NPRDC), San Diego, California and alternately 
sponsored by NPRDC and the Bureau of Naval Personnel (BUPERS), Washington, 
D.C. The author would like to express his appreciation for the valuable 
assistance provided by the staffs of Mr. Robert K. Lehto of BUPERS and 
Mr. Joe Silverman of NPRDC. Thanks are due to Mr. Robert Boller of NPRDC 


for his day-by-day assistance on the project. 


I. INTRODUCTION 


A. Background and Problem Statement 


This is the third technical report on the problem of estimating the length 
of service (LOS) distribution of advancees in the Enlisted Navy. The research 
that was devoted to this topic was part of a series of research projects on 
personnel problems of the Enlisted Navy sponsored alternately by the Naval 
Personnel Research and Development Center (NPRDC) in San Diego and the Bureau 
of Naval Personnel (BUPERS) in Washington, D.C. during the fiscal years (FY) 
1975-77. 

The problem of estimating the LOS distribution of advancements, which 
is the subject of this report, originated in the notion that the shape of 
this distribution should be a highly sensitive function of the total "volume" 
of people to be advanced from one pay grade to the next. As was reported 
previously (Milch, 1976a and 1976b), the dependence of the LOS distribution 
of advancements on the total volume of advancees to a pay grade may be ex- 
hibited not from the data but through a model of the advancement system. 

In fact, two models--a regression model (Milch, 1976a) and a simplified 
analytic model (Milch, 1976b)--were built. Both of these serve the purpose 
of estimating the LOS distribution of advancements as a function of the volume 
of advancements and the LOS distribution of the net inventory in the next lower 
pay grade. Net inventories are defined as inventories at the beginning of the 
fiscal year less losses plus nonrecruit gains to the Navy during the fiscal 
year. Net inventories in a pay grade serve as a resource population for ad- 
vancees to the next higher pay grade. 

The models developed in the reports by Milch, 1976a and 1976b were tested 
on three ratings (Operations Specialist, Radioman and Personnelman). They 
were also compared to the method of estimating the LOS distribution of ad- 


vancements currently used by FAST, BUPERS' comprehensive computer model that 


attempts to duplicate practically all personnel flows in the Navy Enlisted Force. 

Based on these comparisons and on detailed discussions with the sponsors, 
it was decided to choose the analytic model (Milch, 1976b) for its conceptual 
and computational advantages and use it to estimate the LOS distribution of ad- 
vancements of all ratings. Although based on the three ratings mentioned above 
the model's predictive qualities definitely surpassed those of FAST, it was 
considered necessary to compare the two estimating procedures for all ratings 
before the new method could be incorporated in FAST. 

The present report summarizes some of the difficulties that were encountered 
when the new procedure was extended to all ratings and provides a rating-by- 
rating comparison with the current FAST estimating procedure. For a full under- 
standing of the present report, it is necessary to have familiarity with the 


regression and analytic models both explained in Milch, 1976b. 


II. DISCUSSION OF EXTENDING THE MODEL 


A. Computational Problems of Extending the Model to All Ratings 


In the previous report by Milch, 1976b the moments of the regression model 
were approximated by formulas that made their computation less cumbersome. From 
these formulas the parameters of the gamma distribution were estimated through 
the method of moments. Then the gamma distribution was used to provide an es- 
timate of the LOS distribution of advancements to a pay grade of any given 
rating. This way the estimated distribution depended on only fifteen para- 
meters. Although these fifteen parameters must originally be computed from 
the ninety-three regression coefficients of the regression model, this compu- 
tation need be performed only once until new additional data becomes available. 
The fifteen parameters (for each pay grade of each rating) would then be stored 
in the computer. 

From these parameters the model would then compute a new estimated LOS 
distribution of advancements for every new set of pay grade total (volume) of 
advancements and net inventory LOS distribution. When new data of net inven- 
tories and advancements become available the regression could be redone, a 
new set of fifteen parameterscomputed and stored in the computer. These could 
then be used for estimating the LOS distribution of advancements for the next 
fiscal year. 

The extension of this procedure to all ratings presented some problems, 
mostly in cases where only a few years of data were available on which to per- 
form the regression. The apparent statistical instability in the resulting re- 
gression coefficients caused the approximating formulas for the moments of the 
estimated LOS distribution of advancements to become highly inaccurate. This 
caused the formula for the sample variance to become negative in some cases 
which rendered the method of moments for estimating the gamma parameters infea- 


sible. 


In mathematical terms the problem is described as follows. The formulas 


approximating the first two moments of the regression model were given in Milch 


1976b by 
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with S (81), s-) defined analogously, and Os Bi> We are the regression 


coefficients in the regression equations: 
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Here A. and I. are the number of advancements to a pay grade and the net 
inventory in the next lower pay grade, respectively, both in LOS cell ib. 


Finally, V is the total volume of advancements to the pay grade: 
ep! 
Mies) OMe 
i=l 
Then the sample variance is computed from 


he (3) 


In order to investigate under what circumstances Ky may be negative 


formulas. (1) and (@) are rewritten as 


K PAU ere (4) 
and 
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where 
a=S,(a)+S,(81)  , b = S.(y) 
e=S,(a)+8,(61) , d = 8, (y) (6) 
e=$8,(a) +8,(81) , £ = S,(y) 
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P(V) = AV + BV+C<0O G7) 
where 
2 
A = 21bf = 16d 
B = 21(af + be) - 32cd (8) 
2 
C = 2lae - 1l6c 


As is evident from (7) the problem becomes one of investigating the 
location of a parabola, P(V) = 0, with respect to the V-axis (see e.g. Thomas, 
1962, pp. 465-473). 

First, the coefficient A decides whether the parabola "opens" on the "top" 
or "bottom." Fortunately, A depends on the y coefficients only and does 


not depend on the inventory distribution. 


The case when A> 0 is the more favorable one because then--at least for 


A 


V large enough--P(V) > 0 and so Ky is positive for large enough volume of 
advancements. 

The case when A <Q supplied some of the instances where the 
problem of a negative variance arose. Even when it did not for current volume 
of advancements, the potential was there that at some volume levels, reached 
in some future fiscal year, P(V) and so rd also would turn negative. To 


forestall such eventuality a "correction'"' was made in the y coefficients. 


Namely a new set of y coefficients was defined as 
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Then Ky and K, were recomputed with 1 replacing every Ys value, 
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using the Cauchy-Schwarz inequality (see e.g. Thomas, 1962, p. 152) with 
a Sse and east ia. 

With the case A <0 eliminated by design, the possibility of A=0 still 
remained. From (10) it is evident that A = 0 could occur only when Y; = 
same value for all i=1, ..., 31. For all practical purposes this could oc- 
cur only if all original Va <0 thus making We = 0 forall i< Uiilaoseeeee 

Although this did not now occur in any of the pay grades of any of the 
ratings, its future possible occurrence is not ignored. 

With A > O assured the remaining question is whether or not the parabola 
crosses the V-axis and if so whether on the positive or negative side. Since 


the parabola may be written as 


its vertex is at the coordinate point (h,k) where 


2. 
B _ BY = 4ac 
h=- aA and k= - aa aaa 


and it crosses the V-axis at the points 


i 2A 
and 
-3 + ¥B°-4AC 
Sr an 
provided A = Be - 4AC > 0 


The case when A <0 causes no alarm, since then P(V) > 0 and so 
m > 0 for all values of V. 


Teja > 0 and V5 < 0 again problems cannot arise since P(V) > 0 and 


A 


so Ky > U0 for all positive values of V. 


’ 


D <0 will occur when- 


If,..however, A> O and V5 > O the problem of K 


ever the volume V happens to be lower than V Indeed, the computations 


9° 
showed that after the "y-correction'' was made all problems arose in such cases. 


A 


This problem was solved by the following procedure used whenever Ky < 0 


occurred: 


aA 


(i) Let V = smallest integer that is > V, (12) 


A A 


(ii) Recompute K,, K and K;. using formulas (1), (2) and 
2 2 8 


A 


(3) except that V replacing V. 


Although this procedure is quite arbitrary, it does eliminate the problem 
of negative variance, it apparently is needed mostly in cases where the small 


amount of data available created a statistical instability and finally it 


worked quite well in most instances. At any rate, it usually occurred when the 
volume was quite low and so the case was quite unimportant, yet a procedure 
was necessary to assure that the computer will not "hang up." 

Note that the case when A = 0, i.e. the parabola becomes a straight line, 


is covered in the above case. Then 


lim -B+ /p7-4AC 
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and the rest follows as before. 
The estimation procedure may be summarized in the following points: 


(i) Perform regression analysis as described in Milch 1976b to obtain 
regression coefficients Oy > By> v1 for, inevb, 2,5 .... eee 
(ii) Compute the fifteen parameters S (2) S (8), s_(8°), SY) and Q- 
r=0,1,2; then compute $_(BI) for r = 0,1,2 as described in Milecho us 
(iii) Compute A from formulas (8) and (6). If A <0 redefine Yao 


i <i < 32, according to formula: 79).. 


a a 


(iv) Compute K,> Ky and Ky from formulas Gi), \(2)> ands “Gees 


9 <0 compute A, B, C from formulas (8) and define V from 


' 
formulas. (2) and (Gil) when A‘ 0 “or formulas’ G2)" gaacqueee 


A a “a 


when A= 0. Then recompute K)> K, and Ky using V in place V 


insstormuias? (iC)! G(2)be-andes (3). 


(v) Estimate the gamma parameters via the method of moments, i.e. 


(vi) Compute the discretized gamma distribution: 


z es 4st -rAi 
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(vii) If g > 50 use the discretized normal distribution instead of the 


above: 
eee fe od : 
n Re is 2 5 
Gen. = for 2 is"4) =. 31 
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31 eae 
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where Lu = K and of = Hs 


The last step was used to avoid some computational difficulties with the 


gamma distribution when g > 50. 


B. Some Data Problems 

Some difficulties with the data was described previously in reports Milch, 
1976a and 1976b. All data used here were supplied by NPRDC. The regression 
analysis was performed with the data for the 1966-76 period or whatever portion 
of it was available for a specific pay grade and rating. 

The net inventory data was computed by NPRDC from beginning inventory and 
non-recruit gains and losses. This data bears the label of matrix ID997. 
Advancement data was available both "into" a pay grade and "out of" a pay 
grade. Generally advancements "into" a pay grade were used bene this data 
bears the label of matrix ID800. 

There were some exceptions to this in cases where so-called general ratings 
and service ratings interrelate at a certain pay grade level. 

In Appendix A a list of all ratings and their codes is given. The list 
also indicates the range of pay grades (PG) for each rating. A distinction 


between general (GEN) and service (SER) ratings is also shown in the list. 


This is essential because of the way service ratings are related to certain 
general ratings. Basically two types of relationships exist: 

(i) "branching off" relationship where a service rating branches off from 

a general rating at some pay grade, e.g. the rating Legalman (LN, rate 
code 1750) branches off the rating Yeoman (YN, rate code 1700) at pay 
grade E5; 

(ii) "merging" relationship where two or three service ratings merge into 

a general rating at some pay grade, e.g. ratings Missiles Gunners Mate 
(GMM, rate code 0601) and Guns Gunners Mate (GMG, rate code 0604) merge 
into rating Gunners Mate (GM, rate code 0600) at pay grade E8. 

These service ratings and their relationships to their general rating are 
shown graphically in Appendix B. 

For both types of service ratings some explanation is necessary regarding 
the use of the data and the estimation procedure. In the case of a service 
rating "branching off" at a certain pay grade, e.g. rating 1750 branching off 
rating 1700 at pay grade E5, the regression analysis for the service rating 
in pay grade E5 used the net inventory of pay grade E4 of the general rating. 
Similarly when estimating advancements to pay grade E5 of rating 1750 (service 
rating) via the estimation procedure described in Section A the appropriate 
inventories are those in pay grade E4 of rating 1700 (general rating). 

Another exception arises when estimating advancements from the highest 
existing pay grade of services ratings that merge into a general rating. Here 
the advancement data used in the regression analysis was advancements "out of" 
a pay grade. This data is labeled as matrix ID810. In these cases there were 
two or three sets of estimated advancements to the lowest existing pay grade of 
the general rating, namely one from the highest existing pay grade of each of 
the relevant services ratings. To distinguish among these sets of estimated 


advancements, they are listed among the service ratings even though they are 


10 


advancements to a pay grade that exists for the corresponding general rating 
only. To draw attention to this fact the rate codes bear a negative sign in 
front of the code number. Thus advancements from pay grade E/7 of service ratings 
0601 and 0604 to pay grade E8 of general rating 0600 are shown as advancements 

to pay grade E8 of ratings '"-0601" and "-0604." This is evident in Appendix 

C where the errors defined in the next section are shown for all pay grades 


of all ratings. 


1a 


III. COMPARISON OF THE MODEL TO THE CURRENTLY USED FAST METHOD 


FAST, the computer model used by BUPERS to make personnel predictions for 
the Navy Enlisted Force (see Boller, 1974 and Silverman, 1977) has incorporated 
in it a procedure to predict advancements by LOS. The procedure first computes 
historical rates of advancements details of which are described in a working 
paper by Leland (1976) of the Naval Personnel Research and Development Center. 
If these rates are denoted by Hs 1 <i < 31, the advancement LOS distribu- 


tion used by FAST is given by 


OSH. E10: by 
i i 


i 23 
) (0.9H, + 0.11.) 
fa j j 


i.e. advancements are estimated as a mixture of the historical rates of ad- 
vancements and the current resource population (net inventories). 

To compare the FAST estimation with the estimates produced by this study, 
three measures of error were devised. These errors were defined in Milch 1976b 
and are reproduced here for ease of reference. 

(i) The difference between the actual and the estimated mean LOS of 


advancements: 


(ii) The difference between the standard errors of the actual and the 


estimated LOS distributions of advancements: 


Here Ky is the sample variance of the actual LOS distribution of 


advancements and Ky is the sum of squares of the difference between 


nie. 


the estimated number of advancements and the actual mean LOS of advance- 
ments. For example, for the estimated LOS distribution of advancements 


provided by the model in the previous section 


Note that this quantity differs from Ky as defined by Formula (3). 


For the FAST model Ky is computed analogously. 


(iii) The Kolmogorov-Smirnov (K-S) Statistic: The largest absolute difference 
between the actual and estimated cumulative sample distribution func- 


tions: 


A, = max | p C= _ F, | 


where F, is the actual relative frequency of advancees in LOS cell 


j and P is its estimate. In particular, 


A 


f£(4; g, 4) for the advancement model 


. for the FAST methodology 


The meaning of error Ay is quite clear and an accurate estimation pro- 


cedure should have a Ay close to zero. As a rule of thumb, a mean LOS which 


is off by no more than half a year, i.e. [A < .5, may be considered a quite 


1! 
accurate estimate of the actual mean LOS of advancements. Perhaps for the upper 
pay grades E7, E8 and E9 a somewhat bigger A, error is also acceptable. 


The meaning of error Ay is less obvious. The original thought behind it 
was to introduce an error that would compare the estimated and actual standard 


deviations of the LOS distribution of advancements. The actual standard devia- 


tion, of course, is a measure of the dispersion, about the actual mean LOS, 


13 


of the actual LOS distribution of advancements. The estimated standard deviatio 
measures the analogous quantity for the estimated LOS distribution of advance- 
ments. It seems more appropriate, however, to compare the actual dispersion 
(i.e. standard deviation) to the estimated dispersion, about the actual mean 
LOS, of the estimated LOS distribution of advancements. This is precisely what 


the error A, accomplishes. 


Finally, to create a gauge that measures the accuracy of the entire distri- 


bution itself, the error A, was devised. As is clear from its definition 


A, compares the actual and estimated cumulative distribution functions and is 


determined by their greatest absolute difference. Contrary to Ay and Ay> 


the error A, is always nonnegative. 


Of these three errors Ay and A. seemed to be the most useful. Error 


A, is somewhat difficult to interpret and sometimes took on values that con- 


tradicted both Ay and A,- Indeed, it seems that a method of estimation 
that is accurate in terms of its mean (A, error) and in terms of the overall 
distribution (4, error) may be judged to be a satisfactory estimation procedure 
The procedure used here to compare the two estimation methods was to esti- 
mate the FY 1976 advancements for each pay grade of each rating using both the 
FAST and the advancement model. Since actual FY 1976 advancement data was 
available the errors Ads A> and A, could be computed and compared for the 
two models. 


In Appendix C the errors A Ay» and A, are listed for every pay grade 


1? 
of every rating for both the FAST and the advancement models. These lists pro- 

vide a rating by rating comparison, for each pay grade, of the two estimation pr 
cedures. One may compare them, for example, in terms of rating 000 which is the 


code for ALLNAVY, i.e. advancements in the entire Enlisted Force. The list of 


errors are shown in Table 1 for easy comparison. 
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ALLNAVY Errors 


PG Error A 


E A 
EYOY 3 


Error A 


i 
On7a/ 
0.349 0.232 
0.719 0.009 
02758 O.177 
FAST gees 1 
ADV. =0.032 
FAST hea a) 
ADV. 0.290 
-0.249 
0.557 
-0.538 
0.437 


2 


TABLE 1 
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From Table 1 the advancement model is seen to be superior, although not 
uniformly so. In terms of error Ay the advancement model is occasionally, 
as in case of E6 and E7, vastly superior to FAST. When FAST is better than 


the advancement model, as in case of E5 in terms of all three measures, the 


difference is not very significant. 


Since a rating-by-rating comparison from Appendix C is awkward between 
the two estimation procedures, histograms were prepared for each pay grade 
that show the relative frequencies of errors of each type among all the 
ratings. These histograms are displayed side by side for the two estimation 
procedures in Appendices D, E, and F for errors Ay» Ans and A,> respective- 
ly. The horizontal scales were fixed for each pay grade to be the same for 
the FAST and the advancement models to facilitate the comparison. Each 
histogram carries under it a wealth of statistical information related to 
it. Among all these statistical measures appears the median which in this 
case is a value such that exactly half the ratings have errors exceeding it. 
These medians were selected as the best single statistical measure by which 
to compare the two methods. Table 2 provides a summary of these median 
errors for both methods for each pay grade E4 through E9. In addition to 
these six pay grades, the table includes the median errors of all pay grades 


which were taken from histograms also included in Appendices D, E, and F. 


Both the histograms themselves and their brief summary in Table 2 reveal 
that the advancement model does almost uniformly better than the FAST model. 
Notable exception is pay grade E5 where FAST has somewhat smaller A, and A, 
errors. “ft is quite codspienous from Table 2, however, that in pay grades 
E6, E7, and E9 FAST grossly underestimates the mean LOS whereas the advancement 
model makes only small errors overestimating the mean. 


A disadvantage in comparing the two methods by the histograms in Appendices 


Median Errors Among All Ratings 


Error A, Error A. 


TABLE 2 


D, E, and F is that all ratings, small or large, are treated equally. In actu- 
ality accurate predictions in ratings with only few advancees matter little in 
comparison to ratings where several hundred (or thousand) advancements are made 
each year. For that reason, pay grades with low volume were first eliminated 
and then new histograms produced of the remaining errors. What constitutes 
"low volume" was arbitrarily decided for each pay grade separately. Thus for 
pay grades E4 through E9 the ratings for which the total number (volume) of 
advancements made in FY 1976 were below the numbers 3, 10, 20, 32, 40, and 50, 
respectively, were omitted from the next set of histograms shown in Appendices 
G, H, and I. A summary of the median errors among these "high volume" ratings 
is provided in Table 3. 

The results in these histograms and in Table 3 are not significantly dif- 
ferent from those presented above for all ratings. FAST shows some improve- 
ment, especially in pay grade E9 where ratings of only one or two advancees 
have been eliminated. The advancement model stays at the same level of accuracy 
or improves somewhat. 

Finally, it may be pointed out that there are some cases where both FAST 
and the advancement model produce extremely poor estimates. Most of these 
cases occur in pay grades with very low volume where the data lacks statistical 
stability. Because of the low volume these cases are considered unimportant. 
There are some few instances, however, where the estimates perform poorly even 
though there is sufficient data to have established statistical stability. 

The most notable example is pay grade E4 of rating Mess Management Specialist 
(MS, rate code 2200). Although the volume of advancements was almost 3000 

in FY 1976, FAST and the new model both underestimated the mean LOS of advance- 
ments by unacceptable amounts (2.5 and 1.6 years, respectively). The only pos- 
sible explanation for this is that BUPERS made radical changes in its advancemen 
policy for this rating in FY 1976 which rendered the statistical data of the 


past ten years meaningless. 
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Median Errors 


Among High Volume Ratings Only 


Error A 


3 


TABLE 3 


dle 


IV. CONCLUSIONS AND RECOMMENDATIONS 


A rating-by-rating comparison of the estimation method of FAST, currently 
used by BUPERS, and the newly constructed method of estimating advancements 
described previously (Milch, 1976b) clearly shows the overall superiority of 
the latter. Exceptions to this rule do exist, depending also on which measure 
of comparison is used, most notably in pay grade E5. However, FAST practically 
nowhere appears to be overwhelmingly superior to the advancement model. The 
opposite of this occurs in many cases; namely, in pay grades E6, E/7, and E9 
the advancement model outperforms FAST by a huge degree when measured by the 
accuracy of the mean LOS estimate. 

It is recommended therefore that BUPERS modify the FAST model by incorpo- 
rating in it the newly constructed method of estimating advancements. Efforts 
are currently under way to produce programs that will facilitate such a con- 
version of FAST. 

This recommendation is made in full recognition of the fact that the ac- 
curacy may deteriorate in future years. As indicated in Section III, in some 
ratings the estimates proved to be highly inaccurate probably due to abrupt 
changes in advancement policies. Obviously such changes may occur in the fu- 
ture again. Although in such cases the recommended estimation procedure may 
break down there is no reason to think that it would do so more often or to 


a larger extent than the currently used FAST method. 
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APPENDIX A 


LIST OF RATINGS 
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APPENDIX A (Continued) 


MR 
BT 
EM 
To 
HT 
Pm 
ML 
EA 
CE 
EO 
Ci 
BU 
Sw 
UT 
AD 
AT 
AX 
Aw 
Ad 
AQ 
AC 
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APPENDIX B 


RELATIONSHIPS OF GENERAL RATINGS TO THEIR SERVICE RATINGS 
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